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(57) A system for monitoring a user's usage of a tar- 
get application. Such a target application can. as exam- 
ples, be a software program running on a computer or 
a workstation, an image forming device, an appliance 
etc. The target application Includes a user interface with 
a plurality of commands which a user can select In the 
example of the target application being a software pro- 
gram, the commands may be icons displayed on a com- 
puter screen which a user can point to with a mouse 
pointer and then dick on. In the case of the target ap- 
plication being an image forming device or an appliance 
the interface may be an operation panel with buttons a 
touch pad. etc. whfch a user can press. The present In- 
vention monitors the user's usage of such interfaces and 
ogs data of the user's usage of such interfaces. The 
logged data is stored in the form of an abstract class 
and the abstract class is sent to a sending unit The 
logged data can then be communkated by the sendinq 
unit by Internet man to a designated location 
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Oeser^itlon 

Field of the InvBfiHnn 



PWOIJ This Invention generally relates to an applica- 
ton unrt monrtoring device which can monitor a\«^8 
usage of a target application of an application unit and 

rreStc."-^^"'^-— 

Dtojssion of the Bacfccj tnnnH 

lii^ t ^''**'"*"'9"'«=«"tbu8ine8s.ln 
equating software, it may be beneficial to monitor ex- 
actly how a user utilizes a software application As aL 
example it may be helpful fora softwTSSoJ^r to 
know whch commands a user uses most ofter 
I0003I Further, In designing devices with which a hu- 
-nan Interacts, it may be desirable to monit^ ho,^ Z 
user Interacts with such a device. As an exan^le ttm^ 

bede.^tetomonltorhowauserutiiizesaco'J^.r 
ei of an image fomiing device such as a copyingVro- 
chjne. facsimilemachine. printer, scanner. an^Ja^ 

TuTn'?'^'^'^^ ^^'^^ «^'gta'cameraSu^ 
phone, palm top computer, etc. 

rw»04I Further, more and more users are utiiizlna the 
ntemet. There Is significant interest In how^^u^ 
*e .ntemet, particularly with respect to how us^.^^ 
use certain web pages etc. IMonitoring a user's usa« 

[MWq In these instances when It is desired to deter- 
mine how a user is utilizing a certain application, fbrw- 

but. thelnfomiatlonobtelnedbymonltorlngthe users us 
age mustbeeffecdvely communicated toades^p^- 



SUMMARY OF THE INVFWTinM 

PW061 One object Of the present Invention is to pro- 
v^eanoveandelfectlvesystemformonltoringause^s 
S l?rT?"^"'^«"Wlioationunit. 

provide a novel system for communicating date ob- 
temed by monrtonng a user's usage of a target applfca- 
"on of an application unit to a desired par^ 
POMl A further object of the present Invention is to 

pm«deaneff,clentcommunlcationofthemonftoredus 
^n^orrnatlon from a monitoring unit to a sending unit. 

POWlThepnesent invention achieves theseandoth- 
rt«2!f "^age a user interface of 

a target apphcafon of an application unit. Such a mon- 

SS^"'!L°"^''"'^'^''^"'*°^««<>««'«rep,ogZ 
to ngexecuted on a computerorworlcstatlon underW! 
trolbyauser.usageofacontn,lpanelofanlmagef^. 
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ing apparatus such as a copying machine orinter ft«^ 

Tvi^Zs " '^"^'^'^ m^2;^: 

en VCR, digital camera, cellular phone, palm top com 
P"te^.fto-oranyotherdeviceorsyst;SJi2,'^Z^ 

^ge 0 a target application of an application unit ^ 

asaft,rtherfeatureinthepresentlnventlon.becolleS 
and togged and then communicated to a desiS^ 

« ^:S^t"^r^''^^"-°'--''-'^-^n 

H?°^''^^^'*'^''~'"'""nicatingsuch 
data. The data can be communicated to the desl^ S 
cadon at several instances, including ^x^T^ 

apredetenninednumberoftlmesthatauserha^utilS 
« andexltedthetargetappllcationoftheappilSu"? 
BRIEF DESCRIPTinM ^ct he Drawinr..; 

20 .w^i- '^T'®'^P'®*®^P^«^'a«on of the present 

derstood by reference to the following detailed descSJ- 
nying drawings, wherein: »«»mpa 

25 

F^re 1 1llustrates three networked business office 

n^inesconnectedtoanetworkofcomputersand 
date bases through the Internet; 

ieS'^^**~^^"'^°'«<''9««'«>P- 

Rflureaillustratestheelectroniccomponenteofthe" 
digitel copier/printer illustrated in Figure 2- 

Figure 4 Illustrates detells of the muM-port'commu- 
nwation interface illustrated in Rgure 3- 

^ """^ off-we devices areconnected 
to a computer Which is connected to a network, and 
ateo devces which are connected directly ..; the 

RguroBA illustrates In block diagram tomiat a man- 
nerin which lnfom«tion may be communic^teTto 
or from a device using electronic mail- 
Rgure 6B illustrates an altematlve way of commu- 
ning using electronfc mall In which fte computer 
whfch is connected to the devfce also serves as a 
message transfer agent; 

Figure 8C illustrates an kitemative way of commu- 
n^ting using electronfc mail in which an applto- - 
ton unrt includes eiectronic mall capability 

Rgure7lllustratesanaltemativemannerof"sending 
messages across the Internet; 
Figure 8 illustrates an exemplary computer whfch 
may be connected to the devfce and used to com- 
municate electronfc mall messages- 

® '"^S™'" a «'nnec- 

ttonofamonltoringandiogglngblockandasending 

biocktoatargetapplfcatton of an application unit in 
the present invention; 
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Figure 1 0 shows one example of an application unit 
to which the present invention can be applied; 
Rgure 11 shows a second example of an applica- 
tion unit to which the present invention can be ap- 
plied; 

Figure 12A shows an overall view of objects exe- 
cuted in the present invention; 
Figure 12B shows infomiation in an abstract class 
transferred between a monitoring block and a send- 
ing block in the present invention; 
Figure 13 shows a start monitoring operation exe- 
cuted in the present invention; 
Figure 14 shows an operation of setting a trigger 
type and a number of sessions operations In the 
present Invention; 

Figures 15(a) and 16(b) show command usage op- 
erations whteh can be executed In the present In- 
vention; 

Figures 16(a) and 16(b) show stop monitoring op- 
erations whfch can be executed in the present in- 
vention; 

Rgure 1 7 shows a sending control operation which 
can be executed In the present Invention; 
Figure 1 8 shows a structure of abstract and derived 
classes in the present Invention; 
Figure 1 9 is a flowchart describing an operation ex- 
ecuted In the present Invention directed to the ac- 
cessing of data from an abstract class; 
Figure 20 shows the structure used by the abstract 
dass; 

Figure 21 shows an operation performed In the 
present invention with respect to a first derived 
dass of an abstract class; and 
Figure 22 shows a second operation performed In 
the present Invention directed to a second derived 
dass of an abstract class. 

DESCRIPTION OF THE PREFERRED 
Eiy^BODIMENTS 

[0011] Refeningnowtothe drawings, wherein likeref- 
erence numerals designate Identical or con^esponding 
parts throughout the several views, and more particu- 
lariy to Rgure 1 thereof, there is illustrated afigure show- 
ing various machines and computers for monitoring, di- 
agnosing and controlling the operation of the machines. 
In Figure 1 . there Is a first networic 16, such as a Local 
Area Networic (LAN) connected to computer wori<sta- 
tions 17, 18, 20 and 22. The worf(stations can be any 
type of computers Induding IBM Personal Computer 
compatible devices, Unix based computers, or Apple 
Madntoshes. Also connected to the networic 16 are a 
digital copleryt>rinter 24, a facsimile machine 28, and a 
printer 32. The devices 24, 28 and 32 and the woricsta- 
tions 1 7, 18, 20 and 22 ara refen-ed to as machines or i 
monitored devfces and other types of devtees may be 
used as the machines or monitored devices, including 
any of the devices discussed below. Also, a facsimile 



server (not illustrated) may be connected to the networic 
16 and have a telephone, ISDN (Integrated Servfces 
Digital Networic), or cable connedton. In addition to the 
digital copier/printer 24, facsimile machine 28, and print- 

5 er 32 being conneded to the networic 1 6, these devtees 
may also Indude conventional telephone and/or ISDN 
and/or cable connections 26, 30 and 34, respedn^ely. 
As is explained below, the business office machines or 
business devtees 24, 28 and 32 communicate with a re- 

10 mote monitoring, diagnosis and control station, also re- 
fen^ed to as a monitoring device, through the Internet via 
the networic 1 6 or by a direct telephone, ISDN, wireless, 
or cable connection. 

[0012] In Rgure 1 . the Internet is generally designated 

IS by 10. The Internet 10 Indudes a plurality of Intercon- 
nected conrtputers and routers designated by 12A-12I. 
The manner of communicating over the Internet Is 
known through RFC docujments obtained by FTP at 
NIC.DDN.MIL or at FTP NISC.SRI.COM. TCP/IP relat- 

^ ed communication is descn'bed for example in the book 
TCP/IP Illustrated,- Vol. 1 , The Protocols, by Stevens, 
from Addlson-Wesley Publishing Company, 1994, 
which Is Incorporated herein by reference. 
[001 3] In Rgure 1 , a firewall 1 4 is conneded between 

25 the Internet 1 0 and the networic 1 6. A firewall Is a device 
that allows only authorized computere to access a net- 
woric or other computers via the Intemet. Rrewalls are 
known and (x>mmercially available devices and/or soft- 
ware and, for example, include SunScreen from Sun Ml- 

30 crosystems Inc. Similarly, a firewall 50 Is conneded be- 
tween the Intemet 1 0 and a networic 62. Also, a firewall 
40 is connected between the Intemet 1 0 and a woricsta- 
tion 42. 

pOI 4] The networic 52 is a conventional networic and 

35 indudes a plurality of woricstations 56, 62, 68 and 74. 
These woricstations nnay be different departments within 
a company such as a mariceting, manufaduring, design 
engineering and customer servtee departments. In ad- 
dition to the woricstations conneded via the networic 52, 

^ there is a woricstation 42 which is not directly conneded 
to the network 52. Infomfiatlon In a data base stored In 
a disk 46 may be shared using proper encryption and 
protocols over the Interriet to the woricstations conned- 
ed direc% to the networic 52. Also, the woricstation 42 

<5 includes a dired connection to a telephone line and^or 
ISDN and/or cable 44 and the data base in disk 46 may 
be accessed through the telephone line, ISDN, or cable. 
The cable used by this Invention nriay be Implemented 
using a cable which typteally is used to carry television 

50 programming, a cable whfch provides for high speed 
communication of digital data typk^lly used with com- 
puters or the like, or may be Implemented using any de- 
sired type of cable. 

[0015] Infonnation of the business office machines 
*5 24, 28 and 32 may be stored In one or more of the data 
bases stored in the disks 46, 54, 58, 64, 70 and 76. Each 
of the customer sen^ice, mariceting, manufaduring, and 
engineering departments may have their own data base 
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or may share from one or more data bases. Each of the 
disks used to store data bases is a non-volatile memory 
such as a hard disk or optteal disk. Alternatively, the data 
bases may be stored in any storage device including sol- 
id state and/or semiconductor menwry devices. As an 
example, disk 64 contains the marketing data base, disk 
58 contains the manufacturing data base, disk 70 con- 
tains the engineering data base and disk 76 contains 
the customer service data base. Alternatively, the disks 
54 and 46 store one or more of the data bases. 
[0016] In addition to the wor1(statlons 56, 62, 68. 74 
and 42 being connected to the Internet, these worksta- 
tions may also Include a connection to a telephone line, 
ISDN, or cable which provides a secure connection to 
the machine being monitored, diagnosed and/or control- 
led and is used during a connection-mode of communi- 
cation. Additionally, if one of tiie Intemet, telephone, IS- 
DN, or cable is not operating properly, one of the others 
can be automatically used for communteation. 
[001 7] A feature of the present invention is the use of 
aconnectionless-modeof communlciEi[tion(e.g., Internet 
email) or transmission between a machine and a com- 
puter for diagnosing and controlling the machine. Atter- 
natively, the email whfch is transmitted may be imple- 
mented using a connection mode of communication. 
The IBM Dfctionary of Computing by George McDaniel, 
1994, defines a connectionless-mode transmission to 
be the transmission of a single unit of data from a source 
servtee access point to one or more destination sen^lce 
access points without establishing a connection.. The 
IBM Dictionary also defines a connection-mode trans- 
mission to be the transmission of units of data from a 
source service access point to one or more destination 
service access points via a connection. The connection 
Is established prior to data transfer and released follow- 
ing data transfer. Additional infomrtation about the con- 
nection-mode and the connectionless-mode of opera- 
tion is described in ttie Handbook of Computer-Commu- 
nications Standards, Vol. 1, 2nd Edition, by William 
Stalllngs, 1990, which is incorporated herein by refer- 
ence. In order to transfer data from one DTE (Data Ter- 
minal Equipment) to another DTE, there Is a unique 
identifier or address for each DTE. This unkfue Identifier 
or address Is usable in both connectionless-modes and 
connection-modes of communication. 
[001 8] Figure 2 illustrates ttie mechanical layout of the 
digital copier/printer 24 illustrated In Rgure 1. In Rgure 
2, 1 01 is a fan fertile scanner, 102 is a polygonal mln^r 
used witii a laser printer, and 1 03 designates an FB lens 
used to colllmate light from a laser (not Illustrated). Ref- 
erence numeral 104 designates a sensor for detecting 
light from the scanner. 105 Is a lens for focusing light 
from the scanner onto ttie sensor 104, and 106 Is a 
quenching lamp used to erase Images on the photocon- 
ductive drum 1 32. There is a charging corona unit 1 07 
and a developing roller 108. Reference numeral 109 
designates a lamp used to lllustiBte a document. to be 
scanned and 110, 111 and 112 designate minors used 



to reflect light onto the sensor 1 04. There is a dmm mir- 
ror 1 1 3 used to refled light to ttie photoconductive drum 
132 originating from the polygon mirror 102. Reference 
numeral 114 designates a fan used to cool the charging 
s area of the digital copier/|3rinter, and 115 is a first paper 
feed roller used for feeding paper from the first paper 
cassette 117, and 116 is a manual feed table. Similariy, 
1 1 8 is a second paperf eed roller forthe second cassette 
119. Reference numeral 120 designates a relay roller, 
10 121 is a registration roller. 122 is an image density sen- 
sor and 123 is a transfer/separation corona unit Refer- 
ence numeral 124 is a cleaning unit, 125 is a vacuum 
fan, 126 illustrates a transport belt, 127 is a pressure 
roller, and 128 is an exit roller. Reference numeral 129 
Is a hot roller used to fix toner onto the paper, 130 is an 
exhaust fan and 1 31 Is the main nrK)tor used to drive the 
digital copier. 

[0019] Figure 3 illustrates a block diagram of the elec- 
tronic components illustrated in Figure 2. The CPU 160 
^ is a microprocessor and acts as the system controller. 
There Is a random access memory 1 62 to store dynam- 
fcally changing information including operating param- 
eters of the digital copier. A read only memory 164 
stores the program code used to run ttie digital copier 
and also Infomiation describing the copier (static-state 
data) such as ttie model number, serial number of the 
copier, and default peirameters. 
[0020] There is a multi-port communication interface 
1 66 which allows the digital copier to communicate wfth 
30 external devk:es. Reference numeral 168 represents a . 
telephone, ISDN, orcable line and 1 70 represents a net- 
woric Further Infonnatton of the multi-port communica- 
tion Interface Is described with respect to Rgure 4. An 
interface controller 1 72 is used to connect an operation 
55 panel 1 74 to a system bus 1 86. The operation panel 1 74 
includes standard input and output devrces found on a 
digital copier including a copy button, keys to control the 
operation of the copier such as number of copies, re- 
ducement/enlargement, daricness/lightness, etc. Addi- 
40 tionally, a liquid crystal display may be included wittiin 
the operation panel 1 74 to display parameters and mes- 
sages of the digital copier to a user. 
[0021] A storage interfece 176 connects storage de- 
vtees to the system bus 186. The storage devices In- 
^ elude a flash memory 1 78 which can be substituted by 
a conventional EEPROM and a disk 182. The disk 182 
Includes a hard disk, optical disk, and/or a floppy disk 
drive. There is a connection 180 connected to the stor- 
age Interface 176 which allows for additional memory 
50 devices to be connected to ttie digital copier. The flash 
memory 178 Is used to store semi-static state data 
which describes parameters of the digital copier whnh 
Infrequentiy change over the life of tiie copier. Such pa- 
rameters include ttie options and configuration of the 
S5 digital copier An option interface 184 allows additional 
hardware such as an external Interface to be connected 
to the digital copier. A clock/timer 187 Is utilized to keep 
track of both the time and date and also to measure 
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elapsed time. 

[0022] On the left side of Figure 3, the various sec- 
tions making up the digital copier are Htustrated. Refer- 
ence numeral 202 designates a sorter and contains sen- 
sors and actuators used to sort the output of the digital 
copier. There Is a duplexer 200 which allows a duplex 
operation to be perfomied by the digital copier and in- 
cludes conventional sensors and actuators. The digital 
copier Include a large capacity tray unit 198 which al- 
lows paper trays holding a large number of sheets to be 
used with the digital copier. The large capadty tray unit 
198 includes conventional sensors and actuators. 
[0023] A paper feed controller 1 96 is used to control 
the operation of feeding paper into and through the dig- 
ital copier. A scanner 194 is used to scan images Into 
the digital copter and includes conventional scanning el- 
ements such as a light, mirror, etc. Additionally, scanner 
sensors are used such as a home position sensor to de- 
tennine that the scanner is In the home position and a 
lamp thennistor to ensure proper operation of the scan- 
ning lamp. There is a printer/lmager 1 92 which prints the 
output of the digital copier and includes a conventional 
laser printing mechanism, a toner sensor, and an Image 
density sensor. The fuser 1 90 is used to fuse the toner 
onto the page using a high temperature roller and In- 
cludes an exit sensor, a thermistor to assure that the 
fuser 190 Is not overiieating, and an oil sensor. Addi- 
tionally, there is an optional unit interface 188 used to 
connect to optional elements of the digital copier such 
as an automatic document feeder, a different type of 
sorter/collator, or otiier elements which can be added to 
the digital copier. 

[0024] Figure 4 illustrates details of the muttl-port 

communication interface 168. The digital copier may 
communicate to external devices through a Centronics 
interface 220 which receives or transmits Inf onnation to 
be printed, a cable modem unit 221 which has a high 
speed connection over cable, a SCSI interface 222, a 
conventional telephone Interface 224 which connects to 
atelephoneline 168A, an ISDN interface 226 which con- 
nects to an ISDN line 168B, an RS-232 Interface 228, 
and a LAN interface 230 which connects to a LAN 1 70. 
A singledevice which connects to both a Local Area Net- 
wori« and a telephone line Is commercially available from 
Megahertz and is icnown as the Ethernet-Modem. 
[0025] The CPU or other microprocessor or circuitry 
executes a monitoring process to monitor the state of 
each of the sensors of the digital copier, and a sequenc- 
ing process Is used to execute the instructions of the 
code used to control and operate the digital copier. Ad- 
ditionally, there is a central system conti'oi process ex- 
ecuted to control the overall operation of the digital cop- 
ier and a communication process used to assure reliable 
communication to external devices connected to the 
digital copier. The system control process monitors and 
controls data storage In a static state memory such as 
the ROM 1 64 of Figure 3, a semi-static memory such as 
the flash memory 1 78 or disic 1 82, or the dynamic state 



data which is stored in a volatile or non-volatile memory 
such as the RAM 1 62 or the flash memory 1 78 or disk 
1 82. Additionally, the static state data may be stored in 
a device other than the ROM 1 64 such as a non-volatile 
s m^ory Including efther of ttie flash memory 1 78 or disk 
182. 

[0026] The above details have been descn'bed wfth 
respect to a digital copier but the present invention is 
equally applicable to otiier business offk:e machines or 
10 devk»s such as an analog copier, a facsimile machine, 
a scanner, a printer, a facsimile server, or other business 
office machines, or an appliance with which a user in- 
terfaces such as a microwave oven, VCR, digital cam- 
era, cellular phone, palm top computer, etc. Additionally, 

IS the present Invention Includes other types of machines 
which operate using a connection-mode orconnection- 
less-mode of communfcation, and also email, such as 
a metering system including a gas, water, or electricity 
metering system, vending machines, or €my other de- 

20 vk» which performs mechank»t operations, such as au- 
tomobiles, and has a need to be monitored, and per- 
forms a function, in addition to monitoring special pur- 
pose machines, and computers, the Invention can be 
used to monitor, control, and diagnose a general pur- 

^ pose computer which would be ttie monitored and^or 
controlled device. 

[0027] Rgure 5 Illustrates an alternative system dia- 
gram of the invention in whfch different devfces and sub- 
systems are connected to the internet 10. fHowever, 

30 there is no requirement to have each of these devk^ . 
orsubsystems as part of the Invention but any Individual 
connponent or subsystem illustrated in Figure 5 is also 
part of the Invention. Furttier, the elements illustrated in 
Figure 1 may be connected to ttie Intemet 10 which is 
illustrated in Rgure 5. In Rguro 5, ttiero is illusti^ed a 
fire wall 250 connected to an Intranet 252. One of the 
computers or devices connected to ttie intranet 252 is 
a servtee machine 254 which Includes therein or has 
connected ttiereto data 256 whfeh may be stored In a 

<o data base fomiat The data 256 includes history, per- 
formance, malfunction, and any other information In- 
cluding statistfcal infonnation of the operation or failure 
or set-up and components or optional equipment of de- 
vfees whfch are being monitored. The service machine 

^ 254 may be implemented as ttie device or computer 
which requests ttie monitored devces to transmit data 
or which requests that remote control and/or diagnosis 
tests be perfomied on the monitored devices. The serv- 
fce machine 254 may be implemented as any type of 

so devfce and Is preferably implemented using a compu- 
. terized device such as a general purpose computer. 
[0028] Another sub-system of Figure 5 includes a fire 
wall 258, an Intranet 260, and a printer 262 connected 
ttiereto. in this sub-system, there is not a separate gen- 

55 erai purpose computer connected between ttie intranet 
260 {or a different type of computer networtc) and the 
printer 262, but the functions of sending and receiving 
electron^ mall messages by the printer 262 (and simi- 
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larly by a copier 286) are performed by circuitry, a mi- 
croprocessor, or any other type of hardware contained 
within or mounted to the printer 262. 
[0029] An aftemate type of sub-system indudes the 
use of an internet service provider 264 which may be 
any type of Intemet service provider inciuding known 
commerciai companies such as America Online, Net- 
com, CompuServe, Niftyserve, the intemet service pro- 
vider Erols, or any other internet service provider. In this 
sub-system, a computer 266 is connected to the Intemet 
service provider 264. through a modem, for example, 
such as a telephone line modem, a cable modem, mo- 
dems which use any type of wires such as modems used 
over an ISDN (Integrated Services Digital Network) line, 
ASDL (Asymmetric Digital Subscriber Une), modems 
whteh use frame relay communfcatfon. any digital or an- 
alog modem, wireless modems such as a radio frequen- 
cy modem, a fiber optte modem, or a devce which uses 
infrared light waves. Further, a business office device 
268 is connected to the computer 266. As an alternative 
to the business office devk:e 268 (and any other devtee 
illustrated in Rgure 5), a different type of machine may 
be monitored or controlled such as a digital copier, any 
type of appliance, security system, or utility meter such 
as an electrical, water, or gas utility nieter, or any other 
device discussed herein. 

[0030] AlsoillustratedinRgure5lsafirewall270con- 
nected to a network 274. The network 274 may be im- 
plemented as any type of computer networic, such as an 
Ethernet network, for example. Networking software 
whfeh may be used to control th6 networic includes any 
desired networking software including software com- 
mercially available from Novell or Mterosoft The net- 
work 274 may be implemented as an Intranet, if desired. 
A connputer 272 connected to the network 274 may be 
used to obtain tnfonriation from a business office device 
278 and generate reports such as reports showing prob- 
lenns whfeh occurred in various machines connected to 
the networic and a monthly usage report of the devices 
connected to the network 274. In this embodiment, a 
computer 276 is connected between the business office 
device 278 and the networic 274. This computer re- 
cehres email communications from the networic and for- 
wards the appropriate commands or data, or any other 
Information, to the business offfce devce 278. While it 
has been stated that the business office devk:e 278 is 
connected to the computer276, there is no requirement 
for a wired connection between the business office de- 
vkje and the computer and communteation between the 
business office devk:e 278 and the computer 276 may 
be accomplished using wires or wireless methods In- 
cluding through the use of radio frequency connections 
and light connecttons which may be through an Infrared 
connection, or through fiber optics, Similarty, each of the 
various networks and intranets illustrates in Figure 5 
may be established using any desired manner including 
tiirough the establishment of wireless networks such as 
radio frequency networics. The wireless communteation 



described herein may be established using spread 
spec^m techniques inciuding techniques which use a 
spreading code and frequency hopping techniques such 
as the frequency hopping wireless nehivoric whteh is dis- 
5 dosed in the Bluetooth Specification whfch Is described 
at the worid wide web site www.bluetooth.com, which is 
incorporated herein by reference. 
[0031] Another sub-system illustrated in Figure 5 in- 
dudes a fire wall 280, an intranet 284. a computer 282 
10 connected thereto, and a copier 286. The computer 282 
may be used to generate reports and request diagnostfc 
or control procedures. These diagnostic and control pro- 
cedures may be perfonned with respect to the copier 
286 or any of the other devfces illustrated in or used with 
f5 Rgure 5. While Figure 5 Illustrates a plurality of fire 
walls, the fire walls are preferable but optional equip- 
ment and therefore the invention may be operated with- 
out the use of fire walls, if desired. 
[0032] Figure 6A illustrates an application unit 300 
20 connected to a typcal email exchange system which in- 
dudes components 302, 304, 306, 308, 310, 312, 314, 
316, and 318 which may be implemented in a conven- 
tional manner and are taken from Rgure 28.1 of Ste- 
vens, above. The appiic:ation unit 300 may be any of the 
25 devtees described herein and the user at a terminal 302 
may correspond to any of the Illustrated computers, 
such as the computer 276 illustrated in Rgure 5. While 
Rgure 6A illustrates the user at a terminal 302 as being 
a sender, the sending and receiving functions may be 
30 reversed in Figure 6A. Further, if desired, there may not . 
be a need for having a user at the terminal. Connected 
to the user at a terminal 302 is the user agent 304. Pop- 
ular user agents for Unix indude MH, Bericeley Mail, 
Elm, and Mush. The user agent creates email messages 
35 to be sent and, if desired, places these messages to be 
sent In a queue 306. The mail to be sent is fonwarded to 
a Message Transfer Agent (MTA) 308. A common MTA 
for Unix systems is Sendmail. Typfcally, the message 
transfer agents 308 and 312 exchange commu nteatlons 
40 using a TCP (Transfer Communication Protocol) con- 
nection or a TCP/IP (Intemet Protocol) connection or 
protocol. It is to be noted that the communication be- 
tween the message transfer agents 308 and 312 may 
occur over the Intemet, but alternatively may occur over 
^ any type of connection induding any networic connec- 
tion such as a local area networic, wide area networic 
and/or an intranet. Further, any desired connection be- 
tween the message transfer agents 308 and 312 may 
be utilized. 

so [0033] From the message transfer agents 31 2, email 
messages are stored In user mailboxes 314 whteh are 
transferred to the user agent 316 and ultimately trans- 
mitted to the user at a terminal 31 8 whteh functions as 
a receiving terminal. 

55 [0034] TheTCPprovides aconnectlon-mode of trans- 
mission. However, a direct connection Is usually not es- 
tablished between the sending terminal 302 and receiv- 
ing temiinal 31 8. Thus, the transmission of an electronte 
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mail message may be considered a connectionless- 
mode of communication when it is being refen^ed to as 
between two users or tennlnals, but when considering 
the transfer between MTAs, the communication is usu- 
ally a connection-mode of communication. 
[0035] As ttie Internet is a network accessible by 
many people and organizations, it is not considered to 
be secure. Therefore, messages transmitted over the 
Internet should be encrypted to keep the messages con- 
fidential. Encryption mechanisms are known and conrv- 
merdally available whteh may be used with the present 
invention. For example, a C library funrtion, crypto, is 
available from Sun Microcomputersfor use with the Unix 
operating system, and other encryption and decryption 
routines are known and commercially available and may 
also be used with this invention. 
[0036] As an altemative to the general structure of 
Figure 6A, a single computer may be used which func- 
tions as the user temnlnal, and also the message trans- 
fer agent. As illustrated in Rgure 6B, the application unit 
300 is connected to a computer 301 which Includes the 
message transfer agent 308. If desired, the ottier com- 
ponents on the sending side of Figure 6A may be Includ- 
ed in ttie computer 301 of Figure 6B including ttie user 
agent 304 and the queue of mail to be sent 306. 
[0037] A furtfier altemative structure is shown in Fig- 
ure 6C in which the message transfer agent 308 is 
fomied as part of the application unit 300. Further, the 
message transfer agent 308 is connected to tfie mes- 
sage transfer agent 312 by ttie TCP connection 310. 
This embodiment of Rgure 6C Illustrates a case In which 
the application unit 300 is directiy connected to ttie TCP 
connection 310 and has an email capability. A common 
instance of this embodiment of Rgure 6C may be the 
application unit 300 is a facsimile machine witfi an email 
capability of RFC 2305 (a simple mode of facsimile us- 
ing internet mail). 

[0038] Figure 7 illustmtes an altemative implementa- 
tion of transfemng mail and is based on Rgure 28.3 of 
Stevens. Rgure 7 illustrates an electronic mail system 
having a relay system at each end. The arrangement of 
Rgure 7 allows one system at an organization to act as 
a mail hub. In Figure 7, ttiere are four WTAs connected 
between the two user agents 304 and 31 6. These MTAs 
Include local MTA 322, relay MTA 328, relay MTA 332, 
and local MTA 340. The most common protocol used for 
mall messages is SMTP (Simple Mali Transfer Protocol) 
which may be used witti tfiis invention, although any de- 
sired mail protocol may be utilized. In Rgure 7, 320 des- 
ignates a sending host which includes the user at a ter- 
minal 302, the user agent 304, and the local MTA 322. 
The application unit 300 is connected to, or alternatively 
included within, the sending host 320. As anottier case, 
the application unit 300 and host 320 can be In one ma- 
chine where the host capability is built into the applica- 
tion unit 300. Other local MTAs Include local MTA 324 
and 326. Mail to be transmitted and received may be 
queued In a queue of mail 330 of ttie relay MTA 328. 



The messages are transferred across ttie TCP connec- 
tion 31 0, which may be, for example, the Intemet, or may 
be any other type of networic or connection. 
(0039] The transmitted messages are receh^ed by the 
s relay MTA 332 and if desired, stored in a queue of mail 
334. The mail is then forwarded to the local MTA 340 of 
a receiving host 342. The mail may be placed In one or 
more of the user mailboxes 314 and subsequentiy for- 
warded to the user agent 316 and finally forwarded to 
10 ttie user at a temiinal 318. If desired, ttie user may not 
be required to be at ttie tenninal and ttie mail may be 
directly fon^^arded to ttie temninal wittiout user Interac- 
tion. Ottier local MTAs at the receiving side Include MTA 
338 and local MTA 336 which may have ttieir own mail- 
'5 boxes, user agents, and temriinals. 

[0040] The vartous computers utilized by ttie present 
invention including the computers 266 and 276, of Fig- 
ure 5 may be implemented as illustrated in Rgui© 8. Fur- 
tfier, any ottier computer utilized by this Invention may 
^ be implemented in a similar manner to ttie computer il- 
lustrated In Figure 8, if desired, including ttie service ma- 
chine 254, computer 272, and computer 282 of Rgure 
5. However, not every element illustrated In Figure 8 Is 
required in each of these computers. In Rgure 8, the 
» computer 360 includes a CPU 362 which may be imple- 
mented as any type of processor including commercially 
available microprocessors from companies such as In- 
tel, Motorola, Hitachi and NEC, for example. There is a 
working memory such as a RAM 364, and a wireless 
30 Interface 366 which communicates with a wireless de- 
vice 368. The communication between the interface 366 
and device 368 may use any wireless medium such as 
radio waves, or light waves, for example. The radio 
waves may be implemented using a spread spectrum 
35 technique such as Code Division Multiple Access (CDA) 
communication or using a frequency hopping technique 
such as that disclosed in ttie Bluetooth specification. 
[0041] There is a ROM 370, and a flash memory 371 . 
alttiough any ottier type of nonvolatile memory may be 
^ utilized In addition to or in place of ttie flash memory 371 
such as an EPROM, or an EEPROM, for example. An 
input controller 372 has connected thereto a l^eyboard 
374 and a mouse 376. There is a serial interface 378 
connected to a serial de^380. Additionally, a parallel 
^ Interface 382 Is connected to a parallel device 384, a 
universal serial bus interface 386 is connected to a uni- 
versal serial bus device 388, and also ttiere is an IEEE 
1394 device 400, comrhoniy refen'ed to as a fire wire 
device, connected to an IEEE 1394 interface 398. The 
so various elements ofthecomputer360 are connected by 
a system bus 390. A disk controller 396 is connected to 
a floppy disk drive 394 and a hard 6\sk drive 392. A com- 
munication controller 406 allows the computer 360 to 
communicate with other computers, or send email mes- 
S5 sages, for example over a telephone line 402, or a net- 
woric 404. An I/O (Input/Output) controller 408 is con- 
nected to a printer 41 0 and a hard disi< 412, for example 
using a SCSI (Small Computer System Interface) bus. 
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There is also a display controller 416 connected to a 
CFTT (Cathode Ray Tube) 414, although any other type 
of display niay be used Including a liquid ciystaJ display, 
a light emitting diode display, a plasnra display, etc. 
[0042] One feature In the present invention is to mon- 
itor usage of a target application of an application unit 
by a user. The term application unit in this Instance re- 
fers to a system which a user interacts with and controls, 
and a target application is a user controlled offering of 
the application unit For example, an application unit 
may typicany be a computer and a target appllcatfon 
may then be a software program, e.g. a word processor, 
running on the computer which a user operates, for ex- 
ample by moving a pointer on a computer screen and 
■dlcking" on certain command Icons to cause the soft- 
ware program to perfomi certain functions. In this sense, 
an application unit in the present Invention can refer to 
any of workstations 17, 18, 20, 22. 56, 62, 68, 74, 42 
shown In Figure 1 running a software program, the com- 
puter 301 shown in Rgure 6B running a software pro- 
gram, etc. An application unit can also refer to an Image 
fonning device such as any of the digital copier/printer 
24, facsimile machine 28, and printer 32 in Figures 1 
and 2. In this instance, each of these device application 
units Includes a user interface, such as operation panel 
1 74 (see Fig. 3), which a user interacts with and utilizes 
to control the device application unit. The present Inven- 
tion can monitor a user selecting controls on such an 
operation panel. As a further example, the application 
unit could also be an appliance, such as a microwave 
oven, with an operation panel. An application unit can 
also refer to any other device, Including software, with 
which a user Interacts, and In ttiis case the target appli- 
cation may refer to only one feature of the software 
which the user interacts witii. 
[0043] One feature of the present Invention is to mon- 
itor the user's usage of such a target application of an 
application unit, and to ^ectlvely communicate data of 
the monitored usage. This data will typically be trans- 
mitted by email by the computer 301 of Rgure 6A or 6B 
or the application unit 300 of Figure 6C. This data of a 
user's usage of a target application of an application unit 
can then be utilized In many ways, for example in Im- 
proving sofhware development, in monitoring usage of 
a device, such as an Image fonning device, discovering 
user difficulties witfi appliances and sofh¥are, finding 
most frequentiy used features of application units, etc. 
[0044] Rgure 9 shows various elements of the 
present invention. More particulariy, Rgure 9 shows an 
application unit 300 including a target application 505 i 
which includes a user interface 510. This user Interface 
51 0 is an interface for a user to control the target appli- 
cation 505. As discussed above, In one conrwnon In- 
stance, ttie target application 505 may be a software 
program running on one of the woricstations 1 7, 1 8. 20, ^ 
22 shown for example In Rgure 1 of tiie present speci- 
fication. In tills instance, tiie user Interface 610 may be 
a display on a monitor of one of these woricstations. This 



Instance of such a target application Is shown In furttier 
detail in Rgure 10 which shows a monitor 600 of one of 
ttie woricstations 17, 18. 20, and 22. In this Instance of 
a target application, a plurality of function keys 605 are 

► displayed on Vtie monitor 600 and tiie user can access 
tfiese function keys by, for example, changing tiie posi- 
tioning of a pointer with a mouse and "clfcking" on one 
of such function keys. As a furttier example. If monitor 
600 Is a touch pad tfie user can control ttie software ap- 

> plicatk>n unit by touching one of tiie function keys 605. 
In these Instances, the present invention monitors each 
time a user "dicks" on or touches one of the function 
keys 605, and logs data of such a user usage for sub- 
sequent communication. 

' [0045] As a further example, and as noted above, the 
application unit 300 may be an Image fonning devk» 
such as the digital copier/printer 26, facsimile machine 
28, or printer 32 also shown in Rgure 1 . In this Instance, 
ttie user interface 51 0 may take ttie fomi of an operation 
panel (e.g. operation panel 1 74 In Fig. 3) with a plurality 
of keys and/or a touch screen whteh a user operates to 
control ttie image fomning device. A specifte example of 
such a user Interface 510 in ttiis instance when ttie ap- 
plicatk>n unit 300 takes the form of a digital copier printer 
26, facsimile machine 28, or printer 32 is shown In Rg- 
ure 11. In ttils instance, ttie present inventfon monitors 
each time a user presses one of the control buttons on 
ttie operatfon panel and logs data of such a user usage 
for subsequent communication. 
IP046] Rgure 11 shows in greater detail an example . 
of a user Interface for an Image forming devtee. Rgure 
11 shows such a user interface 700, whfch can, as one 
example, correspond to ttie operation panel 174 In Rg- 
ure 3. As shown In Figure 11, such an operation panel 
700 may Indude a touch screen 705 on whteh various 
commands may appear whteh an operatorcan select by 
touching different portions of the touch screen 705. The 
operation panel 700 may also Indude a 1 0-key pad 71 0 
and various ottier control buttons 715. In the case of an 
image forming devbe, ttie control buttons 715 may be 
commands for selecting a paper size, changing a mag- 
nification, changing a daricness of a desired image, etc. 
[0047] When ttie application unit 300 In Figure 9 is an 
Image forming device and the user interface 51 0 corre- 
sponds to ttie operation panel 700 as shown In Rgure 
11 . the present invention can monitor a user's selecting 
ttie commands shown In Figure 11 . The operation panel 
fOO shown in Rgure 11 may, witti modifications, also be 
an operation panel for an appliance witfi which a user 
interfaces, such as a microwave oven, VCR, digital cam- 
era, cellular phone, palm top computer, etc. 
[0048] Rgures 10 and 11 show examples of ttie ap- 
plication unit 300 and user Interface 510 of Figure 9 to 
which the present invention can be applied. It should be 
readily apparent to those of ordinary skill in the art tfiat 
ttie present Invention Is directed to various types of ap- 
plication units including various types of user Interfaces. 
Tlie present invention is essentially applteable to any 
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device which includes a user interface and for which It 
is desired to monitor how a user utilizes the user Inter- 
face. 

[0049] Returning to Rgure 9, the present invention 
further includes a monitoring and logging block 515 and 
a sending block 520. The monitoring and logging block 
515 monitors the user's usage of the user Interface 510 
and records or logs data of such monitored usage. At a 
designated time, the logged data of the user's usage of 
the user interface 510 is then sent to the sending block 
520, whteh then communteates such monitored usage 
data to a designated party. The monitoring and logging 
block 515 can be implemented in the devtee Including 
the application unit 300 or in another system control el- 
ement. The sending block can also be implemented In 
the device including the appOcatton unit in Rgure 6C. or 
can also be iniplemented In the computer 301 in Rg. 6B 
to whfch the application unit is attached. The present 
invention can also take the fomi of computer control 
codes recorded on a computer readable medium. 
[0050] Rgure 12A shows an overall system view of 
porttons of the applk»tion unit 300. Rgures 1 3-1 7 show 
the operations executed in the monitoring and logging 
block 51 5 and the sending block 520 shown in Rgure 9. 
It should be noted that Rgures 12-1 7 describe the sys- 
tem and such operations in an object oriented format 
utilizing the unified modeling language such as de- 
scribed in The Unified Modeling Language User Gukle" 
by Booch et al. published by Addison-Wcsley, 1999. 
[0051] In Rgure 12A the object MB 1300 indicates a 
target application to be monitored. The dashed-block In 
Rgure 12A contains objects responsible for the moni- 
toring functions, and thus collectively Indicate a moni- 
toring block object 1200. A CMonitoringlF objert 1305 
performs monitoring functions of the target application 
MB 1300. A CUsageLogger object 1315 includes func- 
tions for logging monitored data obtained by the CMon- 
itoringlF object 1305. The CUsageLogger object 1315 
Interacts with a System object 1325 to obtain system 
information and a CUsageData object 1330 whfch is a 
storage for logged data. 

[0052] A UsageDataSendManager object 1 31 0 inter- 
acts with the CMonitoringlF object 1305. This Usage- 
DataSendManager object 1310 controls transmitting 
monitored data of a user's usage of the target applfca- 
tion MB 1300 as monitored by the CMonitoringlF objert 
1305. This UsageDataSendManager object 1310 inter- 
acts with a CUsagelnfofmation object 1730. whteh can 
modify the data to be transmitted, a LogFile object 1 605, 
whteh can also store data to be transmitted, and a Us- 
ageDataEncoderi^ecoder object 1610 which can en- 
code and decode data to and from the LogFile object 
1605. The UsageDataSendManager object 1310 also 
provides the data to be transmitted to the sending block 
object 1600. 

[0053] Figure 1 2B shows an overall operation execut- 
ed in the system of Rgure 12A. More partteularty, as 
shown in Figure 12B the monitoring block object 1200 



overall cans a function sendUsageData to the sending 
block object 1600 and provides CUsagelnformation to 
ttie sending block object 1600. The CUsagelnformation 
is information of the usage of the monitored target ap- 
s plication 505. This operatfon Instructs tiie sending block 
object 1600 to send the CUsagelnfonnation provided 
from the monitoring block object 1 200. 
[0054] The operatfons performed by the various ob- 
jects noted in Rgures 12A and 12B are now discussed 
10 in further detail In Rgures 13-17. In Rgures 13-17 the 
various functions are preceded by a numeral and a co- 
lon. It should be noted that this nomenclature is not al- 
ways indfcatlve of ttie order of the various operations as 
various operations can be performed In parallel and at 
'5 different times. 

IP055] Rgure 13 shows.a start monitoring control ex- 
ecuted in the present invention. As shown in Rgure 13, 
when a target applteatten MB starts up, the MB object 
1300 calls a function startMonltoring of a CMonitoringlF 
^ object 1 305. This operation indicates that the logging of 
data corresponding to a user's usage of a user interface 
510 is to tegin. The CMonitoringlF object 1305 then 
calls a setTriggerinformation function of a UsageDa- 
taSendManager object 1 31 0. This operation Sjsls trigger 
^ Infomiation indicating when logged data should be sent 
by the sending block 520. How this trigger infomiation 
is set is discussed in further detail with reference to Fig- 
ure 14 discussed below. 

[0056] Ftetuming to Rgure 13, the CMonitoringlF ob- 
30 jecl 1305 also calls a logStartDatafunctfon from a CU- 
sageLogger object 1316. This operation can be execut- 
ed in parallel with calling the sefTriggerinformation func- 
tion of the UsageDataSendManager object 1 31 0 or after 
calling the setTriggerinfomriation function. 
3s POST] The CUsageLogger object 1315 tiien calls a 
GetCurrentTlme function of a CTime object 1320, and 
the cnme object 1 320 then retums CTIme data to the 
CUsageLogger obje<^ 1315. The retumed CTime data 
is data of a start time of the monitoring. Thus, this oper- 
^ ation sends data indteating the start time to the CU- 
sageLogger object 1315, so that It can be determined 
at what tinfie the user started using the user interface 
510 of the target applteation 605 being monitored. 
[0058] The CUsageLogger object 1315 then calls a 
^ setStartTlme function of the CUsageData object 1330, 
and sends the CT me data of the rtart time to the CU- 
sageData object 1330. The CUsageLogger object 1315 
in a next operation calls a getCumulativeUsage f uneven 
of a System object 1325 and the System object 1325 
so retumsUlfsrrdatatotheCUsageLoggerobject1315. In 
tills operation tiie CUsageLogger object 1315 obtains 
from the System object 1326 the number of times that 
users have used the target applteation to be monitored, 
and ttie System object 1325 retums an integer value of 
55 the type Ui^f^. Thus, in this operation, when the target 
application 505 is utilized mora than once, the CU- 
sageLogger object 1315 Is updated to reflect this multi- 
ple usage. 
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[0059] The CUsageLogger object 1315 then calls a 
setCumulativeUsage function and sends the UINTT data 
to the CUsageData object 1330 after IncTOTenting the 
value. The CUsageLogger object 131 5 also calls a get- 
SystemlD function of the System objert 1325, and the 
System object 1325 then returns the CString data to the 
CUsageLogger 1315 which Indicates the system Identi- 
fication. The system Identification identifies the environ- 
ment under which the target application 505 Is mnnlng. 
The purpose of this Identification is to sort out usage 
data from different systems. The CUsageLogger object 
1315 also calls the setSystemID function of the CUsage- 
Data object 1330 and sends the CString data Indicating 
the system identification to the CUsageData object 
1330. 

[0060] Rgure 1 4 shows a specif ic control operation of 
setting thetriggertype. The trigger type Indicates when 
logged data of a monitored usage of a user interface 
61 0 Is to be sent from the sending blodc 520. More par- 
ticularly, and as noted above, in the present invention a 
user's usage of the user Interface 51 0 tan be monitored. 
In this instance, the monitored data can be sent by the 
sending blodc 520 at various times. One operation is to 
send the monitored usage data by the sending block 520 
after every time the user exits the target application 505. 
For example, if the target application 505 is a software 
that the user is running, every time that the user dicks 
on or touches an exit function, the monitored and logged 
data is sent by the sending block 520. As an alternative, 
the user can perfomn a setting so that the monitored us- 
age data Is sent by the sending blodc 520 only after a 
predetermined number of sessions of utilizing the target 
application 505. For example, the user can perfomi a 
setting, or a default operation can perfomi a setting, so 
that only after the user utilizes the target applk:atlon 505 
5 times does the sending blodc 520 send the monitored 
usage data. Figure 14 shows the control operation of 
setting the trigger function. 

[0061] In Rgure 14, the MB object 1300 calls a set- 
SendTriggerType function of the CMonitoringlF object 
1305, and the CMonitoringlF object 1305 in turn calls a 
setSenrfTriggerType function of the UsageDataSend- 
Manager object 1310. The UsageDataSendManager 
object 1 31 0 then calls a setSendTriggerType f unctton of 
the System object 1 325 and provides the System object 
1 325 with the UINT data. The UINT data in this instance 
Is data Indicating the trigger type to send the monitored 
usage data to the sending block 520 after a predeter- 
mined number of sessions utilizing the target application 
505. This operation perfonned by these steps In the 
present Invention thereby sets a trigger type such that 
after a predetermined number of sessk>ns of the target 
appik^tion 505 by a user, a trigger is sent to the sending 
block 520 to send the monitored and togged data to a 
designated location. 

[0062] As noted above, as a further operation of the 
present Invention the MB object 1300 can set. or a de- 
fault setting may be executed to set, a number of ses- 



sions to be executed prior to Issuing a trigger to the 
sending block 520. As an example, the MB object 1300 
can issue a setting for sending the monitored and logged 
data after using a target applk:ation every 5 times. In 
* this operation, after executing the operations noted 
above to set the send trigger type to be after multiple 
sesstons, the MB object 1300 further calls a setNum- 
berOfSessions function of the CMonitoringlF object 
1 305, which in tum calls a setNumberOfSessfons of and 
10 sends the UINT data to the UsageDataSendManager 
object 131 0, whteh in tum calls a setNumberOfSesstons 
function of and sends the UINT data to the System ob- 
ject 1325. In this Instance, the Um data indk»tes the 
MB object's setting or the default setting of the number 
IS of sessions to be executed prior to sending the trigger 
to the sending block 520. The System object 1325 thus 
stores the \J\m data whteh Indteates how many ses- 
sions must be executed prior to sending a trigger. 
(0063] Rgures ISA and 15B show scenarios of mon- 
20 itoring functions of the target applfcation 505 that are 
called when the user uses the user Interface 510. That 
is, these figures show the actual monitoring and logging 
operations executed in the present Inventton when, as 
examples, a user -dicks' on a command In a software 
25 application as the target applbatlon or presses a button 
on an operation panel of an appliance, image fonnlng 
devbe, etc. 

[0064] In Rgure 1 5A, when a user selects a parttouiar 
command from the user Interface 510 of the target ap- 
30 pilcatfon 605 being monitored, the MB object 1300 calls 
a commandUsage function of and sends CString data, 
indicating the name of the command or function on the 
user Interface 510 selected by the user, to the CMoni- 
toringlF obJe<^ 1305. The CMonitoringlF object 1305 
35 then calls a togCommandUsage function of and sends 
the CString data to the CUsageLogger object 1315. This 
function Indicates to the CUsageLogger object 1315 to 
log (store) data of the command or function on the user 
Interface 51 0 seleded by the user. The CUsageLogger 
40 object1315thensendstheCStringdalatoandcallsan 
updateCommandUsage function of the CUsageData 
object 1330. The CUsageData object 1330 then stores 
the name of the selected and monitored command or 
function with a frequency of one if the name does not 
^ exist, l.e. If the name has not been previously selected 
and then stored, or Increments the frequency associat- 
ed with the name if the name exists, i.e. If the name has 
been previously selected and then stored. 
[0065] The command usage scenario In Figure 15B 
50 is identteal to that as in Figure 1 5A except that the CU- 
sageLogger object 1315 also calls a GetCurrentTlme 
function of the CTime object 1320. and in response the 
crime object 1320 sends CTlme data, whteh Indicates 
a cun-ent time, to the CUsageLogger object 1315. The 
55 CTime data is then also sent to the CUsageData object 
1330. In this operation in Figure 15B, in addition to re- 
cording whteh command of the user Interface 51 0 of the 
target application 505 being monitored has been select- 
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ed by a user, the time that such a command is selected 
is also recorded. 

[0066] That Is, in the operation In Rgure 1 5A the only 
data recorded Is that of the command of the user Inter- 
face 61 0 selected by the user, whereas the command 5 
usage operation of Rgure 15B additionally records data 
of the time that such a conrvnand on the user interface 
510 was selected by the user. 
[0067] Figures 1 6A and 1 6B show operations of stop- 
ping monitoring of the user's usage of the user interface ic 
510. Monitoring of the usei^ usage of the user Interface 
510 can be stopped when the user exits the target ap- 
plication 505. For example, when the target application 
605 is software mnning on a woricstation, the monitoring 
can be stopped when the user exits a program being is 
executed. When the target appfication 505 is an opera- 
tion panel of an appliance, an image forming device, 
etc., the monitoring can be stopped when a particular 
Icon/button, such as a start button of a copier, is 
pressed. The monitoring can also be stopped after a 50 
predetermined period of time, after a predetermined pe- 
riod of time during which the user does not use the target 
application, etc. Similar conditions for stopping monitor- 
ing of users usage of the user interface 51 0 can be ex- 
ecuted when the target application 605 is an image 2s 
fonming device such as a copy machine, facsimile ma- 
chine, printer, scanner or an appliance such as a micro- 
wave oven, VCR, digital camera, cellular phone, palm 
top computer, etc. Again, In such circumstances the 
monitoring can be stopped when the user inputs an exit so 
command, after a predetermined time, after a predeter- 
mined time of non-usage, etc. 
[0068] In Figure 18A, when ttie user Is exiting from the 
MB object 1 300, ttie MB object 1 300 initially calls a stop- 
Monitoring function of ttie CMonitoringlF object 1305. 35 
The CMonitoringlF object 1305 then calls a logStopData 
function of the CUsageLogger object 1315 so ttiat the 
CUsageLogger object 1315 can slop recording data of 
usage of tfie user Interface 510 by ttie user. The CU- 
sageLogger object 1315 ttien calls a GetCurrenfTime 40 
function of the CTIme object 1 320, and the CTime object 
1320 then retumsCTime data to the CUsageLogger ob- 
ject 1315 Indicating ttie cunwit time. This current time 
indicates a time that monitoring of the user's usage of 
the interface 510 has been stopped. The CUsageLog- 45 
ger object 1315 then calls a getStartTlme function of the 
CUsageData object 1330, which tiien returns CTlme da- 
ta indicating tiie stored time that the monitoring was 
started. After ttiese operations, tfie CUsageLogger ob- 
ject1316wlll havedataofthestarttlmeof themonltoring so 
and tfie cument time of stopping ttie monitoring. There- 
by, ttie CUsageLogger object 1315 can determine ttie 
duration of time that the user's usage of the user Inter- 
face 510 has been monitored. The CUsageLogger ob- 
ject 1315 then calls a setf^uration function of the CU- S5 
sageData object 1330 and sends UINT data with ttiis 
setDuration function; ttiat Is, in this instance, ttie UINT 
data indteates the duration of time ttiat the user's usage 



of ttie user Interface 510 has been monitored. The CU- 
sageLogger object 1315 also calls a getCumuIativeU- 
sage function of ttie CUsageData object 1330 which 
tiien returns ttie requested data as LTTNT data. The CU- 
sageLogger object 1315 ttien sends ttiis UINT data to 
and calls the setCumulativeUsage function of the Sys- 
tem object 1325, so that ttie next time the monitoring 
operation is executed, the value of how many monitoring 
sessions have been executed Is one more ttian ttie cur- 
rent execution. 

[0069] The CMonitoringlF object 1 305 also calls a ge- 
tiJsageOata function of the CUsageLogger object 1 31 5, 
which In tum returns ttie CUsageData to the CMonitor- 
inglF object 1 305. This data includes all ttie stored mon- 
itoring data including the system ID, cumulative usage, 
start time, usage duration, commands and frequencies. 
The CMonitoringI F objert 1 305 then sends the CUsage- 
Data with a call for a sendUsageDataAtTrigger function 
of ttie UsageDataSendManager object 1310. The Us- 
ageDataSendManager object 1310 ttien calls a get- 
SendTriggerType function of ttie Syst^ object 1325, 
which then retums EXIT data to ttie UsageDataSend- 
Manager object 1310. The returned value EXIT means 
ttiat ttie monitored data is sent to the sending block ob- 
ject 1 600 every time ttie user exits ttie target application. 
The UsageDataSendManager object 1310 ttien sends 
tiie CUsageInf omriatlon, indicating ail of tiie usage data 
of ttie user's usage of ttie user interface 61 0, through a 
sendUsageData function of the sending block object 
1600. The sending block object 1600 ttien perfomis a 
function for sending ttie data to a designated party and 
ttien retums a confimriation signal, YES, to ttie Usage- 
DataSendManager object 1310. 
[0070] This operation shown in Figure 16A corre- 
sponds to an operation in which ttie usage data is sent 
based on a triggering event of a user exiting a target 
application 605. 

[0071 ] The stop monitoring operation indicated in Rg- 
ure 1 6B is similar to ttiat as shown in Figure 1 6A except 
in ttiis operation ttie usage data is sent by the sending 
btock object 1 600 after a predetemnlned number of ses- 
sions. As discussed above, as onefeature inthe present 
invention the monitored usage data can be sent by email 
after a certain number of sessions of a user using the 
target appibation 505. The operation shown in Rgure 
16B con^esponds to sending ttie usage data after such 
a certain number of sessions. The operations 1-9 per- 
fomied in Figure 1 6B are ttie same as performed in Rg- 
ure 16A, and ttieir redundant description thereof is not 
repeated herewith. In ttie stop monitoring operation 
shown in Rgure 16B, after calling the getSendTrigger- 
Type function of ttie System object 1325 and returning 
SSESSION, the UsageDataSendManager object 1310 
also calls a getfSlumberOfSessions function of the Sys- 
tem object 1325. This operation obtains the data previ- 
ously set by a user Indteating ttie number of sessions 
which must be finished prior to sending the monitored 
data in this operation. As shown in Figure 14, the 
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number of sessions can be set in the System object 
1325. The System object 1325 then returns UINT data, 
indicating the number of sessions after which data 
should be sent, to the UsageDataSendManager object 
1 31 0. The UsageDataSendManager object 1 31 0 then s 
sends the CUsageData and a call for a storeUsageData 
fum^n of a LogRIe object 1 605, In this instance, if the 
predetenrnined set number of sessions has not been ex- 
ecuted, the data from a session is stored In a non-vola- 
tiie memory by the LogFiie object 1 e05. The LogFile ob- u 
ject 1605 then sends the CUsageData and a log file 
along with a call for an encodeUsageData function to a 
UsageDataEncoderOecoder object 1610. This opera- 
tion encodes such data, for example compresses such 
data for easier storage, and stores the encoded usage 15 
data in the log file. When the appropriate number of ses- 
sions are completed, then the UsageDataSendManager 
object 1310 sends the CUsagelnfomriation along with a 
call for a scndUsageData function to the sending blocic 
object 1600, which then sends the data and retums a 20 
conflmiation data, YES, to the UsageDataSendManag- 
er object 1310. 

[0072] Figure 17 shows the operations performed In 
the SendlngBlock object 1 600 of Figures 1 6A and 1 6B. 
[0073] The step with nomenclature 1 shown in Rgure 25 
1 7 corresponds to the step with nomenclature 1 0 shown 
in Rgure 1 6A and the step with nomenclature 12 shown 
in Rgure 16B. In this step the MonltoringBlock object 
1 616 calis a sendUsageData function of and sends CU- 
sagelnfomiatlonDerivedl data to a SendMaiFTrigger ob- 30 
ject 1 700. The SendMaiFTrigger object 1 700 also retums 
a confirmation signal YES to the Mpniton'ngBlock object 
1615 after sending out the infonnation. The SendMall- 
Trigger object 1700 then sends 
CUsagelnfomnationDerivedl data to and calis a convert 35 
function of the InputPacic object 1710. The InputPack 
object 1710 can then convert the CUsagelnformation- 
Derivedl data into a different format data 
CUsageinfomnatlonDerived2. This 
CUsagelnformationDerived2 data is then sent to the 40 
SendMairrrigger object 1700. The reason for this con- 
version is to accommodate any different data formats 
that nnay be passed from the monitoring block to the 
sending block according to different sending triggers. 
After the conversion, the data f onrat will be the same 45 
within the sending block object 1600. 
[0074] The InputPack object 1710 then calls a 
GetXXX functk>n of a CUsagelnformationDerivedl ob- 
ject 1 715. The CUsageinfonnatlonDerivedl objert 1 715 
then retums the requested XXX data to the InputPack so 
object 1710. Examples of the data referenced by the 
XXX are system ID, cumulative usage, start time, dura- 
tion, and command usage data. 
[0075] The SendMailTrigger object 1 700 then sends 
the data CUsagelnfomriation DerTved2 to and calis an ss 
encode function of the Security/DataEncode objert 
1720. The Security/DataEncode object 1720 then en- 
codes the CUsagelnformationDerived2 data and re- 



tums text file or CStrIng data to the SendMailTrigger ob- 
ject 1 700; that is the text file or CString data is security 
encoded data returned to the SendMailTrigger object 
1700. This operation in the present invention can en- 
crypt the usage data prior to being sent out by the email 
to ensure security. 

10076] The Security/DataEncode object 1720 then 
calls a GetXXX function from a 
CUsagelnformationDerived2 object 1725. which in re- 
> sponse retums the requested XXX data to the Security/ 
DataEncode object 1720 as done at the step with no- 
menclature 3. 

[0077] The SendMaiFTrigger 1 700 then sends the text 
file or CString of the encoded and encrypted data to a 
SendMail object 1705, atong with a call of a maifThis- 
Data function. The SendMail object 1 705 then sends the 
encrypted data and then retums a confimnatlon signal, 
YES, indicating that the SendMail object 1 705 has sent 
the data, to the SendMailTrigger object 1700. 
[0078] As noted above with reference to Rgure 128, 
In the present Invention the monitoring block object 1 200 
calls asendUsageDatafunctfon of the sending block ob- 
ject 1600 and sends the CUsagelnfomriation to the 
sending block object 1600. That CUsagelnformation 
can vary significantly. More partlculariy, and as noted 
above, the informatfon sent from the monitoring block 
object 1200 to the sending btock object 1600 depends 
on the different trigger infonnation and different infonna- 
tion as to the number of sessions of the target applica- 
tion 505 to be executed prior to sending infonnation from 
the sending block object 1600, A result of this Is that 
there are variations in tiie size of the data and the stmc- 
ture of ttie data to be sent by the sending block object 
1600. As an example, in one feature of the present in- 
vention as discussed above, the monitored data gener- 
ated from the monitoring block object 1200 can be sent 
by the sending block object 1 600 after each usage of a 
monitored target applfcation 505. As another option, the 
monitored data can be sent by the sending block object 
1600 after a certain number of sessions, for example 
five sessions, of the monitored target applteation 505 
have been executed. In tiiose two different instances, 
the amount of data and tiie structure of the data to be 
sent by the sending btock object 1600 wHI vary slgnifi- 
cantiy. 

[0079] One option to address the different data sent 
from tiie monitoring block object 1200 is to'provide dif- 
ferent algorithms within the sending block object 1600 
for each different type of data. However, ttiat type of sys- 
tem would result in the sending block object 1600 be- 
coming very compitoated in requiring algorithms to ad- 
dress ail the different fomns of the data provided from 
the monitoring block object 1200. A further drawback 
with the sending block object 1600 addressing the dif- 
ferent forms of the data is that the algorithms in the send- 
ing block object 1600 would have to be updated every 
time a change was made In the monitoring operation of 
the monitoring block object 1200. 
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[0080] One further feature of ttie present Invention Is 
to make the sending block object 1600 transparent to 
the differences In data ou^)ut from the monitoring block 
object 1200. 

[0081] That Is, as a further feature the present Inven- 
tion may further utilize an approach which avoids requir- 
ing complteated algorithms which would require signifi- 
cant updating in the sending bk)ck object 1600 to ad- 
dress ail the different data sizes and structures output 
from the monitoring block object 1 200. More partbularty, 
the present Invention may further utilize a system which 
defines an abstract dass to interface between the mon- 
itoring block object 1200 and the sending block object 
1600. This operation in the present invention allows the 
sending block object 1600 to be isolated from the details 
of the CUsagelnfommtion sent from the monitoring 
block object 1200. That Is, with this approach in the 
present invention the sending block object 1600 treats 
all of the CUsagelnformation sent from the monitoring 
block 1200 the same, and does not have to determine 
how the data Is represented and how much data Is in- 
cluded in the CUsagelnfomiation, i.e., how many ses- 
sions of data are included therein, the data structure, 
etc. Even more particulariy, in the present Invention as 
shown in Rgure 12B the CUsagelnfomiation passed 
from the monitoring block object 1200 to the sending 
block object 1600 Is an abstract dass. 
[0082] Figure 18 shows a dass diagram of the ab- 
stract dass CUsagelnformation 1800 of Rgure 12B. 
This abstract dass CUsagelnformation 1800 Is used to 
derive two classes, CUsageDataForOneSession 1805 
and CUsageDatalnLogRle 1810. The functions listed in 
the CUsagelnfomfiation abstract class 1 800 In Figure 1 8 
are pure virtual functions. This means that when the 
pointer of the sendUsageData call of Rgure 12B points 
to the abstract dass CUsage Infomiation 1800, and 
more particulariy points to one of the derived dasses 
CUsageDataForOneSessfon 1805 or CUsageDataln- 
LogFile 1810, the actual functions to be executed are 
the functions defined in those corresponding classes. 
Further details of utilizing an abstract dass can also be 
found in the book The C4-1. Programming Language, 
Third Edition, by BJame Stroustrup, Addison Wesley, 
1 997. pages 34-37, the contents of this entire book be- 
ing incorporated herein by reference. 
[0083] The derived class CUsageDataForOneSes- 
sion 1 805 Is a derived dass which results In the sending 
block objed 1 600 sending the monitored Infomiatlon af- 
ter each session of the target applfcation 505, i.e., after 
each time a user exits the monitored target applfeation 
505. The CUsageDatalnLogRle 1 81 0 is a derived class 
whbh results in the sending block object 1600 sending 
the monitored Infomiation of several sesislons, for ex- 
ample five sessfons, of monitored usage at one time. 
[0084] As shown in Figure 1 8, the CUsagelnfomiation 
abstract class 1800 indudes different functions which 
vary based on the derived dass. The functions Indude 
getNextSessionData, getUseriD, getCumulathreSes- 



slonNumber, getStarfTImeForSession, getDurationFor- 
Sessk>n,getConrvnandUsageDataMapForSessk)n. Rg- 
ure 18 also shows the dedaratlons of those fundtons. 
[0085] Thefunctions noted above in theabstractdass 
5 CUsagelnfomrialion 1 800 are all virtual functions which 
are initially set to zero, whfch makes them pure virtual 
functions. What the fundions do is not defined by the 
abstrad class CUsagelnformation 1800. but by the de- 
rived dasses CUsageDataForOneSessfon 1805 and 
10 CUsageDatalnLogRle 1810. That is, the derived dass- 
es CUsageDataForOneSessfon 1805 and CUsageDa- 
talnLogRle 1 81 0 describe the behavior of the functions 
noted above. 

[0086] Figure 19 describes the use of the fundfons 
'5 defined in the CUsagelnfomiation abstrad dass 1 800 
of -F^ure 18. Figure 19 thus shows the operation exe- 
cuted in the sending block objed 1600 to extrad the 
necessary information passed by the monitoring block 
objed 1 200. In the operation shown in F^ure 1 9. an ob- 
^ Jed pointer (objplr) is a pointer to a CUsagelnfomiation 
objed whfch Is aduaily a pointer to an objed of either 
the derived dass CUsageDataForOneSession 1805 or 
CUsageDatalnLogRle 1 81 0. So long as the user of the 
pointer uses the CUsagelnformation portion of the ob- 
25 jed, such as the virtual fundfons, there is no loss of in- 
fomiation to use the CUsagelnformation for both CU- 
sageDataForOneSession 1 805 and CUsageDatalnLog- 
Rle 1810. The sending block objed 1 600 only sees the 
CUsagelnfonmation objed and doesnt know about the 
30 derived dasses. The derived dass CUsageDataForO- 
neSession 1805 contains the Information of interest in 
a memory such as a DRAM, while the derived dass CU- 
sageDatalnLogFiie 181 0 contains the Information of in- 
terest in a file for multiple sessions. The operation 
35 shown in Figure 1 9 allows the sending block objed 1 600 
to access data through a uniform method without having 
to know the number of sessions in or stmdure of the 
passed data. In the sending block objed 1600, the re- 
ceived pointer to the objed is of the CUsagelnformation 
^ abstrad dass 1 800. The monitoring bfock objed 1200 
knows what Infomnatlon to send and assigns the appro- 
priate pointer to the objed, and then passes such infor- 
mation to the sending block objed 1600. 
[0087] in further detail, as shown in Figure 1 9 in a first 
^ step S5 a getNextSessfonData function of the objed 
pointer is called to determine if there is any data avail- 
able. If YES in step S5, indicating that data is present. 
I.e., that a user is utilizing a target application 605 for 
which usage is being monitored, the operation then pro- 
so ceeds to step SI 0 In whfoh the user ID Is obtained from 
an objed pointer to one of the derived dasses calling a 
getUseriD fundfon. The user ID is then placed in the 
message, i.e., the data package to be sent by the send- 
ing block objed 1600, in step SI 5. The operation then 
S5 proceeds to step S20 in whfoh a session number is de- 
termined based on a getCumulatlveSesslonNumber 
fundion being called by an objed pointer to the derived 
class. The session number is then placed in the mes- 
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sage In step S25. The start time Is then obtained in step 
S30 from an object pointer to the derived class calling 
a getStartTimeForSesslon function, and the start time 
is then placed In the message In step S35. The operation 
then proceeds to step S40 In which the duration of the 
monitoring is determined by an object pointer calling a 
getDuratlonForSesslon function. The duration of the 
monitoring is then placed in the message In step S45. 
The operation then proceeds to step S50 In which the 
usage Infomiation from the monitoring is obtained by an 
object pointer calling a getCommandUsageDatalMap- 
ForSesslon function. The usage information is then 
placed in the message in step S55. 
[0088] The operation then proceeds to step S60 in 
which It Is again determined if there is any further data 
^.from monitoring the target application 505 by an object 
pointer calling the getNextSesslonData func^on. If NO 
in step S60, indicating there is no further data, the op- 
eration then proceeds to step S70 In which a message 
is returned, which indicates that the message to be 
emailed is at this time completed and ready to be sent. 
If YES in step S60, the operation then retums to step 
S20 and then obtains the session number, start time, 
duration, and usage infomiation for the next session of 
the target application 505. 

[0089] If the detemninatlon in initial step S5 is a NO, 
the operation proceeds to a step S65 in which missing 
data infomnatlon is placed in the information message, 
and the operation then proceeds to step S70. That Is, In 
step S5 the getNextSesslonData function is called the 
first time. If No Is returned in step S5, then there is no 
data to send. As a result, the message to be emailed 
contains data indicating missing infomiation. 
[0090] Figure 20 shows a stmcture map for storing In- 
fomnation directed to the use of the commands of the 
target application 605, In F^ure 20 the temi "key" cor- 
responds to acommand name, and the term "value" cor- 
responds to a frequency of calling that command, i.e., 
how many times has the command been called. The 
language provides a standard template library 
which contains a map. The map Is the table of Figure 
20 which associates the key and the value. If the se- 
quence of the command use is important, the "key" col- 
umn can also include time infonnat'on from the start and 
the Value" column Include the name of the command. 
[0091 ] Figure 21 shows how the monitoring block ob- 
ject 1 200 sends the pointer of the CUsageDataForOne- 
Session derived class 1 605 and Figure 22 describes the 
operation in the monitoring block object 1200 for send- 
ing the pointer of the derived dass of CUsageDataln- 
LogFileieiO. 

[0092] As shown in Rgure 21 , initially the ClWonitor- 
inglF object 1 305 calls a sendUsageDataAtTrigger func- 
tion from the UsageDataSend Manager object 1310, 
and at the same time sends CUsageData thereto, sim- 
ilariy as shown In Figure 16A. The UsageDataSend- 
Manager object 1310 then calls its own createUsage- 
DataPackager function and generates CUsageDataEx- 



itPackager object 2100. The CUsageDataExitPackager 
object 21 00 serves the f unctton of putting monitored us- 
age data Into the CUsageDataForOneSession object 
1805. The UsageDataSendiy^anager object 1310 then 
5 calls a CUsageDataExitPackager function of CUsage- 
[)ataExitPackager object 2100 to create itseif, which In 
tum calls a CUsageDataForOneSession function to cre- 
ate the CUsageDataForOneSesston derived object 
class 1805. Then, the UsageOataSendManager object 
10 1310 calls a packageUsageData functfon from the CU- 
sageDataExitPackager object 21 00, atong with sending 
the CUsageData thereto. In response to that call, the 
CUsageDataExitPackager object 2100 calls a setU- 
sageData function from the CUsageDataForOneSes- 
IS sion object 1805 along with sending the CUsageData 
thereto. The UsageOataSendManager object 1310 then 
calls its own IsDataReadyToSend function, and when 
data is ready to be transmitted it generates a positive 
YES response to that function call. At this point, the Us- 
^ ageDataSendManager obled 1310 calls a getPack- 
agedUsageData functton from the CUsageDataExit- 
Packager object 2100, whfch In reply sends the CU- 
sageDataForOneSession to the CUsageDataSend- 
Manager object 1310. The UsageOataSendManager 
^ object 1310 then calls a sendUsageData function of the 
sending block object 1600 along with sending the CU- 
sagelnfomiation thereto. The sending block object 1 600 
then confirms that it has sent this infomiation by sending 
a confirmatton YES signal to the UsageDataSendMan- 
30 ager object 1310. 

10093] In the operation shown In Rgure 21 , the Us- 
ageOataSendManager object 1310 receives the trigger 
type signals as discussed for example in Rgures 12A, 
1 6A, and 1 6B. By executing the operation shown in Rg- 
35 ure 21 , the MonitoringBlock object 1200 can send the 
pointer of the CUsageDataForOneSession derived 
class 1805, which results In the operation of the sending 
bkx* object 1 600 sending data for one session of mon- 
itored usage of a target applfcatlon 505 by email. 
^ [0094] In the operation shown in Rgure 22, several of 
the same steps as ^ecuted in Rgure 21 are also exe- 
cuted. In the operatfon executed in the monitoring block 
object 1200 as shown In Rgure 22, the CMonitoringlF 
object 1305 initially calls a sendUsageDataAtTrigger 
^ function, and along with sending CUsageData to the Us- 
ageOataSendManager object 1310. In response, the 
UsageOataSendManager object 1310 calls Its own cre- 
ateUsageOataPackager funrfion and generates a CU- 
sageDataSSesslonsPackager object 2200. The CU- 
so sageOataSSesslonPackager objert 2200 serves the 
function of packaging the monitored usage data of sev- 
eral sessions of a target applfeatton 505 into the CU- 
sageOatalnLogRle object 1810. 
[0095] The UsageOataSendManager object 1310 
then calls a packageUsageData function from the cre- 
ated CUsageOataSSessionsPackager object 2200 
along with sending the CUsageData thereto. The CU- 
sageOataSSessions Packager object 2200 packages 
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the monitored usage data into the CUsageDatatnLog- 
Rle object 1 81 0. The CUsageDataSSesslonsPackager 
object 2200 in response sends a confinnation YES sig- 
nal to the UsageDataSendManager object 1310 to indi- 
cate that it was able to package the usage data. 
[0096] Then, the CUsageDataSSesslonsPackager 
object 2200 calls a getSystemID function from the CU- 
sageData object 1330, whfeh In return sends a CString 
with the system ID back to the CUsageDataSSesslon- 
sPackager object 2200. Then, the CUsageDataSSes- 
slonsPackager object 2200 calls a setSystemID func- 
tion from a CUsageDatalnLogFile derived class object 
1810 along with sending the CString data thereto. The 
CUsageDataSSesslonsPackager object 2200 then 
calls a storeUsageData function from the LogRle object 
1605 along with sending the CUsageData thereto; and 
the Logflle object 1 605 then retums a confimnation YES 
signal to the CUsageDataSSesslonsPackager object 
2200. The CUsageDataSSesslonsPackager 2200 then 
calls a setLogFlle function from the CUsageDataLogln- 
Rle object 1810 along with sending the CLogfile data 
thereto. 

[0097] During these operations, the UsageDataSend- 
Manager object 1310 continually calls a isDataReady- 
ToSend function to itself, and when the data is ready to 
be sent it generates a confimiation YES. Then, the Us- 
ageDataSendManager object 1310 calls a getPack- 
agedUsageData function from the CUsageDataSSes- 
slonsPackager object 2200. whfch In response sends 
the CUsageDatalnLoeRle data to the UsageDataSend- 
Manager object 1310. The UsageDataSendManager 
object 1 31 0 then calls a sendUsageData function to the 
sending block object 1600 ak>ng with sending the CU- 
sagelnfomfiation thereto. The sending block object 1 600 
then confimis that it has sent this data by sending a YES 
signal to the CUsageDataSendManager object 1310. 
[0098] The UsageDataSendManager object 1310 In 
the operation of Figure 22 also receh^s the trigger in- 
fomiation as shown for example in Rgures 12B, 16A, 
and 16B. In the operation shown in Figure 22, the Us- 
ageDataSendManager monitor 1310 provkies usage 
data to the sending block object 1600 whbh contains 
data of plural sessions, for example five sessions In the 
examples discussed above. The sending block object 
1600 then sends the data of the multiple sessions by 
email. 

[0099] With such operations In the present Invention, 
the monitoring block object 1200 perfomns various func- 
tions which are transparent to the sending block object 
1600. That Is, the sending block object 1600 perfomis 
the same operations regardless of the data provided 
thereto from the monitoring block object 1200. As a re- 
sult of such a stnjcture and operation in the present In- 
vention, the sending block object 1600 is very simple. 
Moreover, if any changes are needed in the operations 
executed in a device such as in the present invention, 
for example If the number of sessions is changed, such 
a change is transparent to the sending block object 



1800, and thus the sending block obje<^ 1600 will not 
have to be rewritten to incorporate such changes to the 
monitoring block object 1200. 
[QIOO] With the above-discussed operatfons, the 
5 present invention provMes a control operation for mon- 
itoring a user's usage of a user interface whk?h is part 
of a target application. Further, such an operation of the 
present invention aWows data of the monitored usage to 
be stored and to be transmitted, at appropriately select- 
10 ed tfrnes, by Internet mail. Internet mail is a convenient 
source of such a transmission because such atransmls- 
sion of monitored usage data will typically not be time 
sensitive information. Further, utilizing an Internet mail 
system to communcate such data can significantly re- 
is ducecostsof thetransmlsslon. Further, since the logged 
usage data is sent by Intemet mall in the present inven- 
tion, the logged usage data can be automatically sent 
to a further computer system which may be pro- 
grammed to analyze the usage data transmitted by In- 
^ temet mail. Such an operation made possible by the 
present Invention can greatly increase the efficiency of 
monitoring and analyzing such usage data. 
(01 01 ] In Its preferred Implementation, the present In- 
vention utilizes computera having separate housings 
^ than the device to which they are attached. This would 
allow the Invention to be inexpensively Implemented for 
Installations whteh already have an existing computer 
for perfomnlng the desired processing as the new hard- 
ware costs nray be reduced. Such an an'angement may 
30 also penmit Implenfientation of the invention without 
hardware changes to the device. However, if desired, 
the present invention may be implemented by including 
the appropriate processing and data storage capabili- 
ties in the device which is being monitored and/or con- 
3s trolled In addition to or as an attemath^e to a separate 
computer connected to the dev»e. 
[0102] This application relates to and builds on vari- 
ous concepts whk:h have been disclosed In the cross- 
referenced patents and patent applications which have 
^ been incorporated into tiiis applk^lon by reference. 
This patent application Is Intended to Include not only 
the Inventions disclosed in the related applfcations, but 
also the combinations of various features and functions 
of the individual embodiments which have been dis- 
45 closed In this and each of ttie related applk:ations. Thus, 
a feature disclosed in one of the related applfcations or 
patents may be readily applied a concept disclosed In 
tills invention, and also, the concepts disclosed in one 
or more of the other applications may be applied con- 
50 cepts or features disclosed in ottier(s) of ttie applica- 
tions. Further, an email message may be used for only 
sending, with communication in the ottier direc^on being 
perfomied using a different mode of communteation, 
such as one of the other communfeation modes dis- 
55 closed herein, or a communication mode disclosed in 
ttie related patents and patent applk:ations. 
[0103] This invention may be conveniently imple- 
mented using a conventional general purpose digital 
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computer or micrDprocessor programmed according to 
the teachings of the present specification, as will be ap- 
parent to those skilled in the computer art Appropriate 
software coding can readily be prepared by skilled pro- 
grammers based on the teachings of the present disdo- 5 
sure, as will be apparent to those skilled in the software 
art. The invention may also be Implemented by the prep- 
aration of application specific integrated circuits or by 
Interconnecting an appropriate network of conventional 
component circuits, as will be readily apparent to those ro 
skilled in the art. 

[0104] The present invention includes a computer 
program product which is a storage medium Including 
instructions which can be used to program a computer 
to peifomri a process of the invention. The storage me- is 
dium can include, but is not limited.to, any type of disk 
including floppy disks, optical discs, CD-ROMS, and 
magneto-optical disks, ROMs. RAMs, EPROMS, EEP- 
ROMS, magnetic or optical cards, or any type of media 
suitable for storing electronb instructions. 20 
[0105] Obvtously, numerous additional modifk^tions 
and variations of the present Invention are possible in 
light of the above teachings. It is therefore to be under- 
stood that within the scope of the appended claims, the 
present invention may be practiced othenvise than as 25 
specifteally described herein. 

Claims 

30 

1 . A system for monitoring usage of a target applica- 
tion (503, 1300) by a user said target applfcation 
having an Interface (510) comprising a plurality of 
operations to be selected by a user, said system 
comprising: 35 

a monitoring unit (515, 1200) configured to 
monitor usage data relating to the selection of 
the plurality of operations of the Interface by the 
user and to generate a tog (1 605) of monitored ^ 
usage data; and 

a communk»ting unit (620, 1 600) configured to 
send the log of the monitored usage data 
through a networic. 

2. The system according to claim 1 , wherein a system 
identiffcation Identifying an environment under 
whteh the target applbatton (505) is running is sent 
to the monitoring unit (515, 1200). 

3. The system according to claim 1 or 2, wherein a 
start time and/or stop time is sent to the monitoring 
unit (515, 1200) when monitoring of usage data is 
started and/or stopped. 

4. The system according to any of the preceding 
claims, wherein sending the log of monitored usage 
data is triggered. 



5. The system according to any of the preceding 
claims, wherein a name of a selected and monitored 
conrvnand or func^on Is stored. 

6. The system according to daim 5, wherein the name 
of the selected and monitored command or function 
is stored with a frequency of one If that command 
or function had not been previously selected and 
then stored or wherein a frequency associated with 
the name is Incremented in the log if the name al- 
ready exists. 

7. The system according to any of the preceding 
claims, wherein a time Is recorded when a com- 
mand orfunctk>n Is selected. 

8. The system according to any of the preceding 
claims, wherein different algorithms are provided for 
each different type of monitored usage data to be 
sent 

9. The system according to any of the preceding 
claims, wherein the log is sent by email. 

10. The system according to any of the preceding 
claims, wherein the h>g of the monitored usage data 
Is encrypted before th^ are sent. 

11. The system according to any of the preceding 
claims, wherein the target application is a software 
application and the interface Is a display screen of 
the software applteatton. 

12. The system according to any of claims 1 to 10, 
wherein the target application is a business offtee 
machine. In partkujiar a copying or facsimile ma- 
chine, and the Interface is an operatton panel of the 
business office machine. 

13. A method for monitoring usage of an interface (51 0) 
of a target applk:ation (505, 1300), the Interface In- 
cluding a plurality of operations to be selected by a 
user, comprising the steps of: 

monitoring (S10, S20, S30, S40, S50) usage 
data relating to the selectiori of the plurality of 
operations of the Interface (510) by the usen 
generating a log (1 605) of monitored usage da- 
ta; and 

sending a log of the monitored usage data to a 
networi(. 

14. A computer program product comprising program 
code means for executing the steps according to 
daim 13, when said program is executed by a 
processing means. 

15. A computer program product comprising program 
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code means accordingtodaim Uthat are recorded 
on a data carrier readable by a processing means. 
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